09) 



J) 



(12) 



(43) Date of publication: 

29.12.1999 Bulletin 1999/52 

(21) Application number: 99102527.1 

(22) Date of filing: 10.02.1999 



EuropSisches Patentarrrt 
European Patent Office 
Off ice europeen des brevets (11) EP 0 967 556 A2 

EUROPEAN PATENT APPLICATION 

(51) Inta 6 : G06F 17/30 



(84) Designated Contracting States: 


(72) Inventor: Ha bu, Ma sayoshi 


AT BE CH CY DE DK ES R FRGB GR IE IT U LU 


San Jose, Ca 951 29 (US) 


MCNLPTSE 




Designated Extension States: 


(74) Representative: 


At LT LV MK RO S) 


Schoppe, Fritz, Dipl.-lng. 




Schoppe, Ztmmermann & Stockeler 


(30) Priority: 26.06.1998 US 105519 


PatentanwStte 




Posttach 71 08 67 


(71) Applicant: 


81458 Muncnen (DE) 


Hewlett-Packard Company 


Palo Alto, California 94304 (US) 





(54) Flat Image delivery server 

(57) The inventive flat image delivery (FID) server 
(11) manages image conversion, pariculariy the fetch- 
ing of the image tiles and the stitching of the image tiles 
into the JPEG images. The FID server is part from the 
web server (12), and thus reduces the processing toad 
of the web server. The image conversion of the FID is 
invoked by a static URL request which allows the result- 
ing JPEG image to be cached by proxy servers (14). 
The FID server operates in between a web server and a 
proxy server. The conversion command includes an 
image filename, a resolution size requirement, and the 
image region of interest. The inventive FID server can 
be configured to operate with any imaging protocol or 
tile based server. 
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Description 

TECHNICAL FIELD QF THE, INVENTION 

[0001] This application relates in general to image 
processing and in specific to a delivery server for han- 
dling images requests to reduce the processing load of 
a web server. 

BACKGROUND QF THE INVENTION 

[0002] With the advancement of desktop computer 
systems, digital images have become a generic data 
type. However, the images comprise large amounts of 
data. An international standard for color image com- 
pression known as JPEG emerged to fulfill the need of 
efficient storage and transmission of digital continuous 
tone images. JPEG defines a standard algorithm for 
image compression that represents images with less 
data in order to save storage costs as well as transmis- 
sion time and costs. The JPEG format is discussed in 
JPEG Still Image Data Compression Standard, by W.B. 
Pennebaker and J.L Mitchell. Van Nostrand ReinhoU. 
New York. New York. 1 993. which is herein incorporated 
by reference. JPEG has gained great popularity 
because it allows the interchange of images between 
diverse applications. However, applications normally 
exchange JPEG data streams as single resolution 
images regardless of the target resolutions. For exam- 
ple, typical displays have resolutions of about 72 dots 
per inch (dpi), whereas typical printers can handle 300 - 
1200 dpi or higher. Consequently, displaying a print res- 
olution JPEG image is very inefficient. Furthermore, 
printing a display resolution JPEG image yields a very 
low quality output 

[0003] Another problem with JPEG is that accessing a 
local region of the image requires receiving and decod- 
ing of the whole image. For example, a satellite image is 
usually a very large image, and typically users only 
desire to view a scaled down portion of the image. Thus, 
the entire satellite image must be retrieved and then 
decompressed before any portion of the image can be 
viewed. Therefore, the entire image must be transferred 
over a network, even if only a portion of the image is 
desired. This is highly undesirable in terms of transmis- 
sion time and costs. 

[0004] A prior art alternative to JPEG is a mufti-reso- 
lution format such as FlashPix, which is an image fie 
format that supports mufti -resolution images and pro- 
vides fast local region access. FlashPix is discussed in 
Eastman Kodak Company, FlashPix Implementation 
Guide, version 1.0, 1996. which is herein incorporated 
by reference. The FlashPix files can contain multiple 
resolutions in the same storage, meaning that it stores 
different resolutions of the image, from a small version 
to a large version of the image in the same file. For 
example, a file may contain the original image, a V£ 
scaled down version. Vi scaled down version, and a Vt 



scaled down version. When a user requests a particular 
sized version or a particular resolution version. FlashPix 
will send the closest stored version to the request. 
FlashPix also provides fast access to file resident image 
5 data by organizing the image data as tiles. The image is 
divided into different tiles, which can be individually 
accessed. Thus, a user may view a portion of the image 
without having to retrieve the entire image. 
[0005] However, a problem has arisen from the use of 
io FlashPix when used in a server and client environment. 
Typically, in such as environment, e.g. the World Wide 
Web. the client requests tiles of an image based on the 
required image resolution and the region of Interest 
using an imaging protocol (IP}, which allows the transfer 
r5 of high resolution digital images over the Internet. The 
problem arises when the client or user does not have 
FlashPix installed in their system Thus, the dient is 
unable to receive tile based images. One solution is to 
have the client install a software plug-in, which would 
so allow the receipt of tile based images. However, this 
requires action by the client or user, and thus, can not 
be relied upon as being correctly performed. 
[0006] Another solution is to reform the tiles into a 
JPEG image, which would be readable by the client. 
25 Some IPs have a conversion command that forms a 
JPEG image from several tile images by fitting the tiles 
together. Thus, the JPEG image would be viewable by 
the client or user. Note thai only the tiles associated with 
the desired portion ol the image are used to form the 
so JPEG image, thus the entire image does not have to be 
sent to the client However, the conversion command 
places high computing load on the web or IP server. 
Thus, the web server will have to reformat images in 
addition to handling other requests from other clients or 
ss users. Moreover, the resulting JPEG image from the 
conversion command is not cached by http proxy serv- 
ers. Thus, duplicate requests for the same images will 
have to be completely reprocessed by the web server, 
and this further increases its computing bad. This 
*o severely limits the scalability of the web or IP server. 
The image is not cached because the conversion com- 
mand is typically expressed as a dynamic universal 
resource locator (URL) request This means that the 
URL requests for utilizing the conversion command 
45 includes question character (?) or an ampersand char- 
acter (&). This indicates that the output from the URL is 
for a specific user, e.g. a search engine request and is 
not likely to be repealed by another user. Thus, the 
results of such a URL requests are not cached. Note 
so that a proxy server usually exists on a fire wall which sits 
between a public Internet and an internal intranet and 
protects the intranet from outside intruders. 
[0007] Therefore, there is a need in the prior art for a 
mechanism which reduces the computing load of the 
ss web server in reformatting, and produces images that 
will be maintained in the cache of a proxy server. 
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SUMMARY OF THE INVENTION 

[0008] These and other objects, features and techni- 
cal advantages are achieved by a system and method 
which uses a Flat image Delivery (ED) server to man- s 
age image conversion, which performs the t3e image 
fetching and stitching of the tile images into the JPEG 
images. The ED server is located on a computer system 
separate from the web server, and thus will reduce the 
processing load of the web server. The image corver- 10 
sion of the FID is invoked by a static URL request and 
thus the resulting JPEG image would be cached by 
proxy servers. The FID server works as a third tier in the 
server and client environment specifically working as a 
middle agent to retrieve image tiles from the web server 15 
and stitch them into a single image to be returned to the 
client. Since the conversion command is a static URL 
request the command does not use the ? or & charac- 
ters associated with dynamic URL requests. The con- 
version command includes a FlashPix filename, a so 
resolution size requirement and the image region of 
interest The inventive FID server will operate with any 
IP or tile based server, so long as the FID server has 
been configured to understand the particular protocol 
being used.. 2S 
[0009] Therefore, it is a technical advantage of the 
present invention to manage image conversion with FID 
server that is separate from the web servers. 
[001 0] It is another technical advantage of the pr esent 
invention that the image conversion command used by so 
the FID server is a static URL request, so that the resid- 
ing image will be cached by an attached proxy server. 
(0011] It is a further technical advantage of the 
present invention that the computation work load of the 
web server is reduced, and thus the server system can ss 
be scaled to handle more client users. 
[0012] The foregoing has outlined rather broadly the 
features and technical advantages of the present inven- 
tion in order that the detailed description of the invention 
that follows may be better understood. Additional tea- 40 
lures and advantages of the invention will be described 
hereinafter which form the subject of the claims of the 
invention. K should be appreciated by those skilled in 
the art that the conception and the specific embodiment 
disclosed may be readily utilized as a basis for modify- 45 
ing or designing other structures for carrying out the 
same purposes of the present invention. It should also 
be realized by those skilled in the art that such equiva- 
lent constructions do not depart from the spirit and 
scope of the invention as set forth in the appended so 
claims. 

BRIEF pESCqiPPQN Of the. PRawings 

[0013] For a more complete understanding of the 55 
present invention, and the advantages thereof, refer- 
ence is now made to the following descriptions taken in 
conjunction with the accompanying drawings, in which: 



THE SOLE FIGURE depicts the inventive FID 
server in its operating environment. 

DETAILED DESCRIPTION OF THE INVENTION 

[0014] The FIGURE shows the inventive FID server 
1 1 being used in Internet system 10. The FID server is 
connected between the web server 12 and proxy server 
14. Note that the FID server can also manage requests 
in an intranet LAN, or WAN environments. The FID 
server understands the IP protocol used by the IP 
server 13. An example of IP protocol is Internet Imaging 
Protocol, version 1-0. by Hewlett-Packard Company, 
Live Picture. Inc.. and Eastman Kodak Company, 1997. 
which is herein incorporated by reference. The proxy 
server 14 is located on the fare wall 19, which protects 
the intranet from outside intruders. The FID server 11 
listens on a pre-defined TCP/IP port such as 6001. A 
web client 1 5 requests an image expressed in a static 
URL that includes an image f Be name, region of interest, 
and the desired image size. For example, the request 17 
may appear as follows: 

rmpV/domain.com:8001 /image- 
name.fpx.0.0.0.0.1 .0. 1 .0.300,200 
[0015] The request 17 includes the image file name, 
"image-name.fpx\ The region of interest is indicated by 
four numbers, for example "0.0.0.0.1.0.1.0". The 
desired image size is indicated by two numbers, for 
example,"300.200". which details the width pixels and 
the height pixels, respectively. Note that the numbers, 
and their placement within the request, are for purposes 
of illustration only, as different numbers could be used, 
and their format within the request could be different, so 
long as the FID server understands the contents of the 
request. The image file name is then passed to a prede- 
fined IP server 13. The interpretation of the file name is 
left up to the IP server 13. Note that the IP server 13 is 
the image manager of the web server 12, and in the 
prior an would handle the tasks of the FID server 11. 
The four numbers for the region of interest indicate res- 
olution independent, normalized coordinates ol upper- 
left and lower-right points. For example. 
"0.0,0.0.1.0.1.0* indicates the whole region of the 
image, and "0.5.0.5,1.0,1.0" represents the lower-right 
quadrant. Note that since this request does not include 
the special characters such as ? and &, this is treated as 
a static file request rather than a dynamic request. 
[0016] After the FID server 11 has received the 
request 17 from the client 15, the FID server 1 1 commu- 
nicates with the IP server 13 and receives basic infor- 
mation about the requested image, such as the number 
of resolution layers, maximum image dimension, and 
other image attributes, e.g. color. Based on this informa- 
tion, particularly the region of interest and the desired 
image size, the FID server 11 requests appropriate 
image tiles 16 to the IP server 11. Once the FID server 
11 receives the proper tiles, the FID server decom- 
presses the tiles, stitches them together to form the 
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image, and then recompresses them back into a single 
JPEG image. The FID server may also either scale up 
or scale down the tiled image depending on the 
requested size and resolution. The scaling would be 
performed after the image has been stitched together. 5 
Note that the image is recompressed to save transmis- 
sion costs when the image is sent over the Internet The 
recompressed image is then sent on to the client 1 5. as 
the response to the request Note that compression tor- 
mats other than JPEG could be used in the recompres* w 
sion of the image. 

[001 7} The proxy server 1 4 would retain a copy of the 
scaled, compressed, output image in its cache. Thus, if 
a subsequent URL request is received that has the 
same request information, then the proxy would send a 15 
copy of the cached image to the requesting client 
[0018) Another URL request may include an explicit 
resolution level and request the entire image. For exam- 
ple, the following states the same image f Pe name with 
the explicit resolution layer 3 to be returned. The spe- 20 
crfic resolution layer determines the returned image 
size. 

htlp7/domain. com:8001/i mage- name. fpx.3 
[001 9] Note that the FID server 1 1 communicates wfth 
the IP server using IP protocol on top of HTTP. Further- 25 
more, the FID server can also keep a memory cache of 
compressed tiles so that it can reduce network load to 
the IP server. Since, the FID server uses a particular 
form of IP. only IP or web servers that are compliant with 
the particular form of IP will operate wfth the FID server. 30 
Note the that clients 15 do not have to understand IP 
protocol, or tiled images, as the conversion mechanism 
is located on the web server side of the Internet. 
[0020] Although the present invention and its advan- 
tages have been described in detail, H should be under- 35 
stood thai various changes, substitutions and 
alterations can be made herein without departing from 
the spirit and scope of the invention as defined by the 
appended claims. 

40 

Claims 

1 . An image server (1 1) for managing image requests 
from at least one client (15), wherein the images 
are stored in a storage server (12), the image 45 
server comprising: 

means for receiving (17) an image request 
from the one client 

so 

means for retrieving (16) the image from the 
storage server; 



one dient. 

2. The image server of daim 1, wherein: 

the request is a static URL request. 

3. The image server of claim 2, wherein: 

the static URL request indudes an image file 
name of the image, information indicating a 
desired portion of the image, and information 
indicating a desired image size. 

4. The image server of daim 2, wherein: 

the output image is cacheable by a proxy 
server (14) which resides between the image 
server (1 1) and the one dient (15). 

5. The image server of daim 1 , wherein the means for 
retrieving the image comprises: 

means for disassembling the request into an 
image address and at least one desired 
attribute; 

means for retrieving information about the 
image from the storage server (12) based upon 
the address; and 

means for requesting the image from the stor- 
age server based upon the retrieved informa- 
tion. 

6. The image server of daim 5, wherein the one 
desired attribute indudes a portion of the image, 
and the image is stored in the storage server (12) in 
a tile based format, the means tor retrieving the 
image further comprises: 

means for determining which tiles form the por- 
tion of the image; 

wherein the means for requesting the image 
onfy requests the determined tiles, and the 
means for retrieving the image only retrieves 
the determined tiles for the image. 

7. The image server of claim 6. wherein the means for 
reformatting comprises: 

means tor stitching the determined tiles 
together to form the output image. 



means for reformatting the image into an out- 8. The image server of daim 7. further comprising: 
put image with a format useable by the one di- ss 

ent and means for compressing the output image prior 

to operation of the means for sending. 

means for sending (1 7) the output image to the 
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9. A method tor managing image requests from at 
least one client (15). via an image server {11), 
wherein the images are stored in a storage server 
(12), the method comprising the steps of: 

5 

receiving an image request from the one client: 

retrieving the image from the storage server; 

reformatting the image into an output image io 
with a format useable by the one dient, via the 
image server; and 

sending the output image to the one client 

15 

10. The method of claim 9, wheren the request is a 
static URL request, the method further comprising 
the step of: 

caching the output image in a proxy server (14) so 
which resides between the image server (1 1) 
and the one client (15). 
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